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Abstract —We investigate if feedback can increase the capac¬ 
ity of an energy harvesting communication channel where a 
transmitter powered by an exogenous energy arrival process 
and eqnipped with a finite battery commnnicates to a receiver 
over a memoryless channel. For a simple special case where the 
energy arrival process is deterministic and the channel is a BEC, 
we explicitly compnte the feed-forward and feedback capacities 
and show that feedback can strictly increase the capacity of this 
channel. Building on this example, we also show that feedback 
can increase the capacity when the energy arrivals are l.l.d. 
known noncansally at the transmitter and the receiver. 

I. Introduction 

The capacity of the basic energy harvesting communication 
channel where the transmitter is powered by an exogenous 
energy arrival process and equipped with a battery of size 
Bmax has been of significant recent interest ffl-Q. The 
capacity has been characterized in the two extremal cases 
^max — CJO and -Sjnax = 0 in m and ill respectively. When 
.Bmax is finite, Gl characterizes the capacity as the limit of an 
n-letter mutual information rate under various assumptions on 
the availability of energy arrival information at the transmitter 
and/or the receiver, and derives upper and lower bounds which 
are easier to compute, and which differ by a constant gap. The 
difficulty in characterizing the capacity in this case lies in the 
fact that the channel has an input-dependent state with memory 
which is known at the transmitter but not at the receiver. In 
this paper, we consider the question of whether feedback can 
increase the capacity of this peculiar channel. 

Eeedback naturally comes into play in certain applications 
of energy harvesting networks where the transmitter is pow¬ 
ered by RE energy transfer from its corresponding receiver. 
Such applications include internet of things, where many tiny 
self-powered sensor nodes may be communicating to a sink 
node which has access to conventional power, or REID tags. 
In such applications it can be natural for the receiver to 
provide feedback information to the transmitter along with 
RE energy. We model such a communication scenario with 
a simple model. We assume that the transmitter has a unit 
battery which is recharged periodically every two channel uses 
and the communication occurs over a Binary Erasure Channel 
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Fig. 1. Energy harvesting channel model. 


(BEC). See Eig. [T] We compute the capacity of this channel 
with and without causal output feedback from the receiver to 
the transmitter and show that the feedback capacity is strictly 
larger than the feed-forward capacity. We then extend our 
model to the case of i.i.d. Bernoulli battery recharges and 
show that when the energy arrivals are known noncansally 
at the transmitter and the receiver, feedback also increases the 
capacity of this channel. 

The fact that feedback increases the capacity of the energy 
harvesting channel is indeed surprising. In a classical wireless 
channel, it is clear that feedback can increase the capacity 
by allowing the transmitter to learn the state of the channel 
which is typically available at the receiver. However, in an 
energy harvesting channel the state of the system (captured 
by the available energy in the battery) is readily known at the 
transmitter (but not at the receiver) and communication occurs 
over a memoryless channel. It is tempting to believe that, since 
all information regarding the state of the channel is already 
available at the transmitter, feedback from the receiver will 
not provide the transmitter with any additional information and 
therefore will not increase the capacity of this channel. Indeed, 
it is interesting to note that in his 1956 paper on zero error 
capacity fSl, Shannon claims that feedback would not increase 
the capacity of such channels. Theorem 6 of his paper proves 
that feedback does not increase the capacity of a discrete 
memoryless point-to-point channel. His proof is followed by 
the following interesting comment; 

‘7f is interesting that the first sentence of Theorem 6 can 
be generalized readily to channels with memory provided they 
are of such a nature that the internal state of the channel can 
be calculated at the transmitting point from the initial state 











Fig. 2. Binary erasure channel. 


and the sequence of letters that have been transmitted.^^ 

Our channel model described in Section [II] corresponds to 
a time-invariant finite state channel where the state is com¬ 
putable at the transmitter from the initial state and the transmit¬ 
ted symbol sequence. As such, it provides a counter-example 
to Shannon’s claim. 


II. System Model 

The energy harvesting binary erasure channel (EH-BEC) 
depicted in Eig. [T] has input alphabet X = {0,1}, output 
alphabet y — {0,1, e}, and channel transition probabilities 
given in Eig. |2] The transmitter has a battery with finite 
capacity Bmax = 1. and the input symbol energy at each time 
slot is constrained by the available energy in the battery. Let 
Bt represent the available energy in the battery at time t. The 
system energy constraints can be described as 

Xi < Bt, (1) 

Bt = mm{Bt-i - Xt-i + (2) 



energy constraint ([T]l: /t(w) < bt{ft-i{w)). The receiver sets 
W = giY^). 

When there is feedback from the receiver to the transmitter, 
the encoding function (|4|i is changed to 

ft-.Mx ^ A, (6) 

such that xt = ft{w, In both cases, the capacity is de¬ 

fined in the usual way as the supremum of all achievable rates. 

It is interesting to note that this channel, with or without 
feedback, is equivalent to a finite state time-invariant channel 
where the transmitter can compute the state from the initial 
state of the channel and the transmitted symbol sequence, 
satisfying the conditions of Shannon’s claim discussed in the 
earlier section. Let St = {Pt,Bt) where Bt,Pt G {0,1} and 


where Et is an exogenous process of energy arrivals. Tu- 
tuncuoglu et al. a, 0 considered similar binary channels 
with a unit sized battery, with a noiseless channel and a 
binary symmetric channel (BSC) instead of the BEC, and i.i.d. 
Bernoulli energy arrivals. 

Here we consider a special case where the energy arrivals 
Et are binary and deterministic. In particular, suppose 

f1 odd 

Et = I 

10 ,t even 

Therefore, Bt can be written as 


Bt 


1 , t odd 

1 — Xt-i , t even 


(3) 


We consider this channel with and without feedback. An 
(M, n) code for the EH-BEC without feedback is an encoding 
function / and a decoding function g: 


f -.M^X^, (4) 

g-.y^^M. (5) 


where Xi = {1,...,M}. To transmit message w G Ai the 
transmitter sets x" = f{w). The function / must satisfy the 


* The first sentence of Theorem 6 reads “In a memoryless discrete channel 
with feedback, the forward capacity is equal to the ordinary capacity C 
(without feed-back). ” 


Bt+i = 



,Pt = 0 

.Pt = l 


Pt+i = l-Pt. 


Consider a binary channel with no input constraints, but 
instead assume that when Bt = 1, the channel behaves as 
a standard BEC and when Bt = 0, the channel behaves as a 
BEC with W = 0 at its input, regardless of the actual input 
Xt- This channel is illustrated in Eig. [3] Assume the initial 
state is si = {pi,bi) = (1,1), and it is known beforehand 
both at the transmitter and the receiver. Here the state variable 
Bt corresponds to the battery level in the energy harvesting 
channel and Pt G {0,1} is a state variable indicating whether 
the time t is odd or even (P stands for “parity”). The state 
diagram is shown in Eig. |4] Note that at odd times, the 
state always reverts to s = (1,1). At even times, the state 
is a deterministic function of the past input, therefore it is 
computable at the transmitter, but unknown at the receiver. It 
is easy to see that this time-invariant finite state channel with 
no input constraints is equivalent to our original EH-BEC, as 
codes designed for one channel can be easily translated to the 
other with the same probability of error. 


HI. Capacity Without Eeedback 

The impact of the energy constraint in (O is to prohibit the 
transmission of the input (xi,X 2 ) = (1,1) over a block of 







X = 1 


X = 0 



two channel uses starting with an odd channel use. With this 
additional input constraint, the channel is memoryless over 
blocks of two channel uses from to Y^. The capacity is 
then 

C(a) = i max I(X'^;Y'^) 

= \ - ^2(«)> (7) 

where /i 2 (’) is the binary entropy function, i.e. / 12 (a) = 
-alog 2 a - (1 - a) log 2 (l - a). 

To find the optimal input distribution, we first observe that 
since the channel is memoryless, then by the symmetry and 
the concavity of the mutual information, the inputs (0,1) and 
(1, 0) must have the same probability, denoted tt < 0.5. Then 
p{x^ = (0,0)) = 1 — 27r. The entropy of the output can be 
readily computed, yielding 

I{X^;Y^) = (l-a)2[/i2(27r) + 27r] + 2a(l-a)/i2(7r). (8) 


This is a concave function of tt. To find the maximum, we 
take derivative w.r.t. tt and equate to 0: 


{1-af 


2 log 


1 - 27r 
27T 



+ 2a(l 


a) log 


1 — TT 

TT 


= 0 



Denoting x = we get 

x^/i^-^) + X -1 = 0 . 

This can be solved numerically for any value of 0 < a < 1. 
Specifically, for a = 0.5 we can solve analytically to obtain 
TT = (3 — \/5)/2 Ri 0.382. Substituting in the expression for 
capacity, we have 

C'(0.5) = i[/i2(3 - \/5) + 2/r2((3 - \/5)/2) + 3 - \/5] 

0 

= 0.4339. 


where I{X‘^ —>■ directed information and p(aY\\yi) = 

p(xi)-p(x 2 |xi, j/i) is the causal conditioning input distribution 
with the additional constraint 

p(x 2 = l|xi = 1 , 2 / 1 ) = 0 Vt/ 1 . 

imposed by energy harvesting model. This result has been 
established for a far more general case in 0 (specifically, we 
apply here Theorem 2 and eq. (48) therein). 

Let 

p{xi = 1) =pi, 

p{x2 = l|xi = 0,2/1 = 0) = P 20 , 
p{x 2 = l|xi = 0,2/1 = e) = P2e, 

where 0 < pi,P 20 ,P 2 e < 1- Then the directed information 
in 0 can be written as 

/(X2 ^ ^ I{X,;Y,) + /(X2; ^ 2 !^) 

= H{Yi) + H{Y2\Yi)-2h2{a), 


where 

H{Yi) = / 12 (a) + (1 - a)/i2(pi), 
h{Y2\y,) = (i-pi)(i-a)iJ(r2|yi = 0) 

+ Pi(l-a)iJ(r 2 |ri = l)+aiJ(r 2 |>"i =e). 

Clearly, Yi = 1 implies Xi = 1, which in turn implies 
X 2 = 0. Therefore H{Y 2 \Yi = 1) = / 12 (a). When Fi = 0, 
the input is necessarily Xi = 0, then the input X 2 is 
Bernoulli(p2o)5 which yields 

^(^ 2 !^! = 0) = / 12 (a) + (1 - a)/i 2 (p 2 o)- 

Finally, when Yi = e, we have X 2 = 1 w.p. p 2 e only 
if Xi = 0, and X 2 = 0 otherwise. Therefore X 2 ^ 
Bernoulli(p 2 e(l -Pi)), giving 

H{Y 2 \Yi = e) = / 12 (a) + (1 - a)/i 2 (p 2 e(l -Pi))- 

Summing up all terms, we get 

/(X^ -)> F2) = (1 - a)[/i 2 (pi) + (1 - a)(l -pi)/i 2 (p 2 o) 
+ a/l2(p2e(l -Pl))]- 

This can be maximized by choosing p 2 o = 0.5 and p 2 e = 
min{ 2 (i-pi) 1 !}■ Further optimization over pi G [0,1] yields 

1 

“ 1 + 21-“’ 

We finally get 


IV. Capacity With Feedback 


Consider now the channel defined in Section El with feed¬ 
back. Looking at blocks of size 2, the channel is memoryless 
over different blocks, but with in-block memory. The capacity 
of this channel is given by 


1 

= — max 

2 p(a:=||yi) 


/(X2 ^ Y^), 


(9) 


C'fb(a) = [log(l + 2^ “) + a]. 

For a = 0.5, we get 

Cfb(0.5) = 0.4429 > 0.4339 = C(0.5). 

For all other values of 0 < a < 1, the capacities with and 
without feedback are plotted in Fig. |5] 


Cfb(a) 











Capacity of the EH-BEC with and without feedback 




Fig. 6. Equivalent channel models. The dashed line con'esponds to the 
channel equivalent to the case with feedback. 


Fig. 5. Capacity of the EH-BEC with periodical recharges, with and without 
feedback. 


capacities in the two cases above can be explicitly computed; 


V. Why does Feedback Help? 


In this section, we will try to illustrate the intuition behind 
the usefulness of feedback in this scenario. Recall that the 
state of the battery is 


Bt 


1 , t odd 

1 — Xt-i , t even 


We focus on even times: the transmitter knows the current 
state of the channel Bt, and the receiver has a noisy estimate 
of it Bt = Yt-i- (Note that Yt-i is the output of a BEC with 
input Xt-i = 1 — Bt-) With feedback, the transmitter not 
only knows the true state of the channel Bt but also its noisy 
estimate at the receiver Bt- 

The question of whether feedback can help to increase 
the capacity of this channel is then related to the following 
question; Consider a channel with i.i.d. states St known 
causally at the transmitter. Assume the receiver observes a 
noisy version of the state St- Can the capacity be increased if 
the transmitter knew the receiver’s noisy estimate of the state 
St in addition to knowing the actual state of the channel? See 
Fig |6] The capacity when the transmitter observes only St is 
given by 


C = max/(C/;y,5) = maxI(U;Y\S) ,U :S^ X. 

p{u) p{u) 


When transmitter also observes St, the capacity is 

Cfb = max/((/; FIS') ,U:S^X. 

p{u\s) 

The increase in capacity follows from allowing U to depend 
on S. 

To illustrate that the second capacity can be strictly larger 
than the first assume St = 1 w.p. p and 0 w.p 1—p. St is given 
as the output of a BEC (a) with S* as its input. The channel 
transition probabilities depend on St as in Fig. |7] (note that this 
is exactly the same as Fig. [3 with Bt replaced by St)ll The 


^ This channel does not exactly con'espond to our original EH-BEC and 
has different capacity. We use it to illustrate how feedback can be useful 
to increase the capacity of the EH-BEC, rather than providing a direct 
equivalence. 


C = (1 — Of) ^max^ [p(l — a)h2{r) + a{h2{pr) — rh2{p))] 

Cfb = (1 - a) ^max^ [p(l - a) + a{h 2 {pr) - rh 2 {p))]. 

We can see that Cfb > C with equality iff r = 1/2, which is 
true only when p = 0 or p = 1, or when a = 0 or a = 1. 



St = Q 
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£ 
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Fig. 7. Equivalent channel with i.i.d. states. 


VI. Random Energy Arrivals 

We showed that feedback can increase capacity when the 
energy arrivals are deterministic with period 2. However, the 
model usually studied in the literature involves i.i.d. energy 
arrivals (see e.g. a, 0). We will show that feedback can 
help in this case as well, at least when noncausal observations 
of the energy arrivals are available at the transmitter and the 
receiver. 

Consider the model presented in Section [III with the fol¬ 
lowing modifications; the energy arrivals Et are now i.i.d. 
Bernoulli(p) RVs known noncausally to both the transmitter 
and the receiver. The encoder and decoder functions a and Q 
are now modified to 


/ : X ^ A-”, (10) 

( 11 ) 

where £ = {0,1} is the alphabet of Et- Similarly to (|6]), when 
there is feedback the encoding function becomes 

ft:Mx£^ X ^ A”. (12) 






















We prove the following theorem in Appendix 

Theorem 1. The capacity of the EH-BEC with i.i.d. 
Bernoulli(p) energy arrivals and noncausal energy arrival 
information, with and without feedback, is given by 

OO 

yp2(i_p)fc-i max H{Y^)-h 2 {a), (13) 

OO 

H{Y'^)-h 2 {a), (14) 

where p{x^\\y^~^) = YYi^iP{xi\x^~"^is a causally 
conditioned input distribution, and in both cases the maximiza¬ 
tion is over all input distributions with support X]i=i <\ 
a.s., i.e. only input sequences with at most one 1. 

Observe that for every k we have 

max H{Y^) > max H(Y^), 

Pix>‘\\y'‘-^y. Pix’^y. 

and the results of Sections Hill and HVl imply that the inequality 
is strict for k = 2 and a = 0.5, that is 

max H(Y^) > max H{Y^). 

p(a:^||yi): 

Xi+X2<l Xi+X2<l 

Therefore, we conclude that feedback can strictly increase 
capacity for i.i.d. energy arrivals. 

Appendix A 
Proof of Theorem[T] 

First we note that C < Cfb < 1 — a, and both C and Cfb are 
limits of increasing sequences, so convergence is guaranteed. 
We prove Theorem [T| for the case with feedback; the proof 
without feedback follows exactly the same lines. 

A. Achievability 

Without loss of generality, we assume the initial battery state 
is Bq = 1, or, equivalently, that Ei = 1 w.p. 1. Fix N and 
maximizing distributions {p{x^\\y'^~^)}^^i in (fT4l) . Divide 
the message into N messages, such that R = 

Upon observing e", the transmitter and receiver divide the 
transmission into epochs, where an epoch refers to the time 
between two consecutive energy arrivals. More precisely, e" 
can be mapped to a sequence of integers (fi, £ 2 , • ■ ■,-^m), 
where m(e") = X]"=i 6* '^^e number of energy arrivals, 

£i(e") is the time between the i-th and the {i + l)-th energy 
arrivals, and we let im = n — Each epoch can be 

considered as a super-symbol and the epoch length can be 
thought of as the random state of the channel determining the 
size of the inputted super-symbol. For this super-channel with 
states we use the multiplexing technique in ifTOl Section 7.4.1] 
to communicate a codeword of rate Rk over each state k. 
(Since each £i can take any value between 1 and n, we treat 
all values greater than or equal to N as the state k = N.) 


C = 

Cfb = 


For each state k, we generate a codeword where each super¬ 
symbol x^ is generated according to the pmf p{x^\\y^~^). 
Note that this guarantees the energy constraint O is satisfied. 
For decoding the codeword corresponding to state k, we 
use the technique in ifTTl . ifTOl Section 17.6.3]. Roughly, the 
subcodeword formed by the j-th symbol inside the super¬ 
symbol x^ is decoded separately for 1 < 7 < fc by treating the 
earlier decoded subcodewords and the corresponding channel 
outputs as side information. Thus, for sub-block j we can 
achieve rate I{Xj;Yj^\X^~^,Y^~^). The achievable rate for 
state k is then given by 

k 

Ru = Y.i{x,-y^\x^-\y^-^) 

= i{x^ y'=) 

= H{Y^) - kh2{a), 


where (a) is due to the memorylessness of the channel and 
because H{Yi\Xi) = / 12 (a). 

For a sequence e" and 1 < k < N, the empirical 
distribution of the states, or epoch lengths, is 

m(e") 

7r(fc|e"') = - ^ l{min(£i{e"),iV) = fc}, 

i=l 

where !{•} is the indicator function, and m(e"') and 
i = 1,..., m(e”), have been defined above. Note that this is 
not a legitimate probability distribution, as it does not sum 
to 1. Nevertheless, by the strong law of large numbers for 
regenerative processes: 

1 ) 

= ^ l{mm(f.(E"),JV) = t) 

'' ^ i—1 

—>■ p ■ q{k) a.s. as n —>■ 00 , 


qik) = 


where q{k) is a probability distribution, defined as 

[p(l — pY~^ ,1 < k < N — 1 
,k = N 

We define the following e-typical set for e”: 

= {e" : |7r(/c|e") — pq{k) \ < epq{k), VI < /c < /V}. 
Hence Pr{F;" e 7^^^} 1. 

Now, assuming e" G 7^*'”^ there are Uk > n{l — e)pq{k) 
symbols transmitted in state k. The achievable rate is then 

N 


R = - e)pq{k)Rk 

k^l 

N 


k-l 


[II(Y^)-kh2(a)]. 


k=i 


This is a lower bound to capacity for every e > 0 and > 1, 
therefore we can take e —0 and N 00 to obtain 


Cfb > J^p^(l-p)^-^ff(Y'^) - /12(a). 
k^l 




B. Converse 

By Fano’s inequality; 

nR-nen < IiW-,Y^\E^) 

n 

n 

= Y,I{Xt-Yt\Y^-\E^) 

n 

= Y,[H{Yt\Y*-\E^)-h2{a)] 

= H{Y^\E^)-nh2{a) 

= ^p(e")i/(y"|F;" = e") - nh 2 {a). 

gn 

Recall the definition of TO(e") and f = 1,... ,m(e"), 

as before. We further define i = 1,... ,m(e”), as the 

energy arrival times, i.e. the times for which e* = 1, or C = 
1 + (where again we assume Et = 1 w.p. 1). 

Then we can further upper-bound the rate as 

m(e"') 

nR — ncn < ^p(e") ^ — nh 2 {a) 

e’^ i—1 

m{e^) 

E 

i=l 

where 

C{k)= max H{Y’^) - kh 2 {a). 


which completes the proof. 
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Taking n —>■ c», we get 


C'fb < liminf — E 

n—>-oo ft 


nn{E'^) 

E 


i=l 


where the expectation is over the RV E^. By the strong law 
of large numbers for regenerative processes: 

frpn) 1 m(-E") 

E C(f.(i5"))^p-E|C(L)| a..., 

'' i—1 

where L is a geometric RV with parameter p. Moreover, since 
C(k) < k(l — a) and n = ^ foi' e”: 

- E C{e,iE^)) < (l-a) w.p. 1, 

i—1 

Therefore, by bounded convergence, the above limit converges 
and it is given by 


Qb <P-E[C'(L)] 


= ^c{k) 

k^l 


oo 


= E^0-P) max H{Y'")-h2{a), 






